arXiv: 1502.01166vl [math.NA] 4 Feb 2015 


Tractability of Monte Carlo integration in Hermite 

spaces 


Christian Irrgeher* 
February 5, 2015 


Abstract 


We consider multivariate integration in the randomized setting. The function 
spaces which we study are defined on with respect to the Gaussian measure and 
the functions are characterized by the decay of their Hermite coefficients. We study 


tractability of Monte Carlo integration and give necessary and sufficient conditions 
to achieve tractability. 
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1 Introduction 

Study tractability of multivariate problems, like integration, in reproducing kernel Hilbert 
spaces goes back to the works of Hickernell [1] and Sloan and Wozniakowski [12]. Since 
then different notions of tractability were studied for multivariate problems in various 
function spaces. However, there are only a few results about tractability of multivariate 
integration of functions defined on unbounded domains, see e.g., [ZIEIE]. In this paper 
we want to consider tractability of integration in spaces of functions defined on M®. For 
that, we consider the problem of approximating integrals of the form 



( 1 ) 


where tps denotes the density of the s-dimensional standard Gaussian measure. 



where denotes the standard inner product on M^. Moreover, we consider integrands / 
which belong to a reproducing kernel Hilbert space 'H{K) with norm || • |y. 

In |S] reproducing kernel Hilbert spaces, so-called Hermite spaces, are introduced 
for which the problems ([T]) are well-dehned. These function spaces are defined on the 
with respect to the Gaussian measure and they are based on Hermite polynomials. 
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For Hermite spaces of functions with polynomially and exponentially decaying Hermite 
coefficients tractability of multivariate integration was already studied in the worst case 
setting, see [3] and [B]. 

In this paper we are interested in approximations of ([T]) obtained by Monte Carlo 
(MC) integration rules which are randomized linear algorithms with equal weights and 
randomly chosen integration nodes. That is, we stndy tractability in the randomized 
setting, for more details see Chapter 7 in HD]. We will proceed as in [TS] and [5] where 
tractability of MC integration is stndied for the Korobov space and for the Walsh space, 
respectively. 

The rest of the paper is structnred as follows: In Section [2] we introduce the general 
concept of Hermite spaces. Moreover, we present two interesting classes of Hermite spaces: 
Hermite spaces of fnnctions with polynomially decaying Hermite coefficients and Hermite 
spaces of fnnctions with exponentially decaying Hermite coefficients. Section [3] deals with 
tractability of MC integration in Hermite spaces and we give necessary and snfficient 
conditions to achieve different notions of tractability. 

2 The Hermite spaces 

We start by introducing some basic facts on Hermite polynomials. For more details on 
Hermite polynomials we refer to [21 [mm. For fc G Ko the kth Hermite polynomial is 
given by 

Hk{x) = ■^-^exp(a;V2)^exp(-a;V2), 

where we follow the definition given in [2]. We remark that there are slightly different 
ways to introduce Hermite polynomials, see, e.g., [H]. For s > 2, k = {ki,... ,ks) G Ng, 
and X = {xi, ..., Xg) G we define s-dimensional Hermite polynomials by 

HUx) = YlffkA^y)- 

It is well-known, see [2], that the Hermite polynomials {Hk(x)}k^pi^ form an orthonormal 
basis of the space L^(R^,(ps) of fnnction which are sqnare-integrable with respect to the 
Gaussian measnre. 

Now we are going to define fnnction spaces based on Hermite polynomials. These kind 
of fnnction spaces were first introdnced in [5]. Let r : Ng —?■ M’*' be a snmmable fnnction, 
i.e., < oo- Define a kernel fnnction 

Kr{x,y) = '^ r{k)Hk{x)Hk{y) for x,y eW 

fceNg 

and an inner prodnct 

{f,9)Kr = E 

fceNg 

where f{k) = f{x)Hk{x)ips{x) dx is the fcth Hermite coefficient of /. Since is 
symmetric and positive semi-definite, we indeed have that is a reproducing kernel. 
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see, e.g. [21 Chapter 2.3]. Let us denote by l-i^Kr) the reproducing kernel Hilbert space 
corresponding to K^. The function space 'H(iLr) is called a Hermite space and the norm 
in l-i{Kr) is dehned in the natural way by ||/|||'^ = (/, f)Kr- More details on reproducing 
kernel Hilbert spaces can be found in [T]. 

Note that a Hermite space 'H{Kr) is fully specified by the function r which regulates the 
decay of the Hermite coefficients of the functions belonging to l-L{Kr). Roughly speaking, 
the faster r decreases as k grows, the faster the Hermite coefficients of the elements of 
T-L{Kr) decrease. 

In this paper we deal with two important classes of Hermite spaces, namely Hermite 
spaces of functions with polynomially decaying Hermite coefficients and Hermite spaces 
of functions with exponentially decaying Hermite coefficients. Moreover, we introduce 
weights to the norm of these function spaces to control the influence of each coordinate. 


2.1 Hermite spaces of finite smoothness 

To define our function r, we first choose a weight sequence of positive real numbers, 
7 = { 7 j}jGN with > 0 , where we assume that 

7i > 72 > 73 > • • • • (2) 

Furthermore, we fix a parameter a G (1, cxd). For A; G Mq we consider 


hij 


Ak) 


1 if fc = 0 , 
if fc 7 ^ 0 . 


For a vector fc = (fci,..., G No consider 

S 

'^s,a,~f{k) = W_'^a,'^j{kj). 

i=i 


Clearly, it holds that rs^a,-y is summable. From now on, we use the following notation for 
the kernel function. 


fcSNg 

to stress that the reproducing kernel depends on a as well as on the weight sequence 
7 . The corresponding reproducing kernel Hilbert space is then given by 'H{Ks^a,'y)- This 
choice of r now decreases polynomially fast as k grows, which influences the smoothness of 
the elements in 'H{Ks^a,'y)- In [S] it is shown that the smoothness parameter a is related to 
the differentiability of the functions which makes it reasonable to call 'H{Ks^a,'y) a Hermite 
space of finite smoothness. 


2.2 Hermite spaces of analytic functions 

Let a = {ajjjgN and b = be two weight sequences of real numbers, where we 

assume that Oq := inf^ aj > 0 and bo := infj bj > 1. Moreover, we fix an a; G (0,1) and 
for fc G Nq we define 


rs,Lo,a,b{k) = := u 


33 — 




(3) 
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We denote the reproducing kernel function by 

Ks,u,a,h{x,y) = 

fceNg 

to indicate again the dependence on the weights. The corresponding Hermite space is then 
given by 'H{Ks,^ a,b)- With the choice of rs^uj,a,b h follows that the functions in 'H{Ks^^ a,b) 
have exponentially decaying Hermite coefficients. Furthermore, this exponential decay 
guarantees that the functions are extremely smooth, in fact analytic, see [B]. 

3 Tractability of Monte Carlo integration 

Now we study Monte Carlo integration in a Hermite space 'H(iFr). For that we consider 
MC integration rules which are randomized linear algorithms of the form 

1 

MC,^ 5 (a^i,..., /) ^ ^ f {xi), 

with independent and standard normal distributed random variables Xi, ..., Xn- In this 
setting we are interested in the randomized error of a MC algorithm which is given by 

e^'^(n,s)= sup E(\Is{f) .. ,Xn-, f)f)\ 
feniKr),\\f\\Kr<^ 

where the expectation is taken with respect to independent and identically distributed 
random variables Xi, ..., Xn- Furthermore, we consider the minimal number of function 
evaluations which is needed to reduce the initial error by a factor of £ G (0,1), i.e., 

s) = min{n : s) < e}. 

Note that the initial error is 1. We want to know how depends on and s. 

For that we study the tractability of MC algorithms where we follow the notions given in 
m- We say that we have: 

1. Weak MC-tractability, if 


Um Mdlhilii) = 0. 

S +£ 1—>-00 S -(- £■ ^ 

2. Polynomial MC-tractahility, if there exist c,p,q E M"*" such that 

n^^{e,s) < cs'^ for all s G M, e:G(0,l). 

3. Strong polynomial MC-tractability^ if there exist c, p G M’*' such that 

s) < ce~^ for all s G N, £ G (0,1). 

The infimum of p for which strong polynomial MC-tractability holds is called e- 
exponent. 
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With weak MC-tractability we rule out that the smallest number of function evalua¬ 
tions needed to achieve an ^-approximation depends exponentially on and s. Polyno¬ 
mial MC-tractability means that n^^(£,s) is bounded polynomially in and s. In the 
case of strong polynomial MC-tractability the upper bound is a polynomial in and 
independent of the dimension s. 

First we derive a formula for the randomized error where we see that the error de¬ 
pends on the number of integration nodes by a factor of 1/y/n. This coincides with the 
convergence rate of MC algorithms of 


Theorem 1. For the randomized error of MC integration in the Hermite space FLlKr) it 
holds that 


gMC 


(n, s) 



max 

feeNg\{o} 



1 

2 


Proof. We know for the randomized error that 
e^'^{n,s) = sup 


- I.U) 


1 

2 \ 2 


see, e.g., Theorem 1.1], Moreover, by Parseval’s identity. 


and 


= [ fixy^s{x)dx = 

JR® 


E 


Isif) = [ fix)ipsix)dx = /(O). 
JR-^ 


Hence, 


Uf)-Wf= E />)' 

fcGNg\{0} 

= E r{k)-^f{kfr{k) 

fcGNg\{0} 

< ll/lll- max r{k) (4) 

“ fceNg\{o} ^ ^ ^ ^ 

Now we set k* = arg max;^,gj^gy|Q|r(fc) and we consider the special integrand f{x) = 
Hk*{x). Then we get for the fc-th Hermite coefficient of /, 


/>) 


1 if fc = fc* 

0 otherwise 


Thus, we have that (jl]) is fulfilled with equality for this choice of /. Hence, it follows that 


e^^(n,s) = —= ( max r(k)] 
y/n VfeeNg\{0} 7 


□ 
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3.1 Tractability in Hermite spaces of finite smoothness 

Now we consider MC-tractability of multivariate integration in Hermite spaces 'H{Ks a,'y) 
of functions of finite smoothness. Since 

k 

max rsa'yik)= max TT 7 ,-, 

fceNgUo} ^ k=i,...,s 

we get from Theorem [T] that the randomized error of MC integration is given by 

e^^{n,s) = ^ I max 7i ] • (5) 

We remark that this result is similar to the result in [TH] and therefore we proceed in the 
same way to study MC-tractability for the integration problem. 

From ([S]) we see that MC integration is strongly polynomially MC-tractable if and only 
if sup^gpj 11^=1 7 i < oo. Assume there exists a j with ■jj < 1 , then we have that 7 * < 1 
for all i > j. Now let jo the smallest index such that 7^0 < 1. Then sup^gj^ n^=i 7 i < 
is equivalent to Ij < 00 • On the other hand, if 7 ^ > 1 for all j G N, we have that 
11^=1 7 j ^ Iff 11^=1 7 j ^ Altogether, we have that sup^gj^ n-=i 7 j < cx) is 
equivalent to niax( 7 j, 1 ) < cx) which, in turn, is equivalent to max(log( 7 j), 0 ) < 

CX). 

Furthermore, we see from (jS]) that we have polynomial MC-tractability iff there exist 
C, g > 0 such that maxfc=i_...^s 11^=1 7j < Cs'^. As above, we get that this is equivalent to 
sup,6NE^=imax(log(7j),0))/log(s) < cx. 

Finally, we again conclude from ([S]) that integration is weakly MC-tratable if and only 
if maxfc=i,...,s log( 7 i)/s approaches zero as s goes to 00 . Again this is equivalent to 
lims^oo Kiax(log( 7 j), 0)/s = 0. Now we summarize our results in the next theorem. 

Theorem 2. MC integration in the weighted Hermite space is 

1. strongly polynomially MC-tractable niax(log( 7 j), 0)) < 00 , 

2. polynomially MC-tractable iff A := lim sup^^^o 

3. weakly MC-tractable iff 

Let us give some remarks on Theorem [21 We see that the conditions are necessary and 
sufficient. Moreover, these conditions are fulhlled, if the weight sequence contains weights 
which are smaller or equal than 1. Especially, in the case of the unweighted Hermite 
space, i.e., 'jj = 1 for all j G N, we can achieve these three notions of MC-tractability 
using randomized linear algorithm. 

Note that, if we have strong polynomial MC-tractability, then the e:-exponent is 2. 
Furthermore, the minimal number of function evaluations which is needed to 

guarantee that the randomized error is smaller than £ is 

sup s) = Ce~^ 

seN 
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with C = sup^gpj 11^=1 7i < oo. If we have polynomial MC-tractability, then 

s) < as s ^ oo 

with A as in Theorem [2J Furthermore, we remark that the conditions on MC-tractability 
of multivariate integration in Hermite spaces of hnite smoothness are the same as for 
Monte Carlo integration in Korobov spaces, see [13], and in Walsh spaces, see [3]. 


3.2 Tractability in Hermite spaces of analytic functions 

For the Hermite space of analytic functions we have that 


max Ts^abik) = max TT '’ = u°‘° < oo, 
feeNg\{o} ’ ’ ’ ^ ^ 

because Oq = inF a,- > 0 and bj > 1 for all j G N. From Theorem [T] we get that 


u' 


ao 


e^^{n,s) = ^ 
/n 


( 6 ) 


and it is easy to see that we can achieve MC-tractability independent of the choice of the 
weight sequences a and b. 

Theorem 3. MC integration in the weighted Hermite space 'H{Ks^i^^a,b) is strongly poly- 
nomially MC-tractable, polynomially MC-tractable and weakly MC-tractable for all a and 

b. 


In the worst case setting it is natural to expect exponential convergence for studying 
multivariate integration in the Hermite space of analytic functions, see |H] • From Theorem 
[Tjit follows that we can not achieve exponential convergence for the error in the randomized 
setting by using standard Monte Carlo integration, but maybe it could be done by more 
sophisticated randomized algorithms. 

Furthermore, in [B] notions of tractability are considered to study the dependence of 
^Mc ^ loge:“^. If 


lim 


log(n'^^(£, s)) 
s + log£“^ 


0 


(7) 


with logO = 0 taken by convention, it is ruled out that the minimal number of func¬ 
tion evaluations to achieve an e-approximation to the initial error depends exponentially 
on s and loge“^. However, ([7D cannot hold for Monte Carlo integration, because 


n^C(£,s) = 


^-2^2ao 


We remark that it is possible in the worst case setting to achieve better convergence rates 
and related notions of tractability, if we restrict ourself to function spaces of analytic 
functions, see [B]. However, this is not possible in the randomized setting using Monte 
Carlo integration as we have seen in this section. 
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